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ABSTRACT 


The convergence characteristics of an iterative method for solving area search games 
were investigated. This method, Fictitious Play, was first introduced by G. W. Brown 
and solves two-person zero-sum games bv having each plaver sequentially select a pure 
Strategy based on the combined past actions of his opponent. The Fictitious Play 
method was successfully implemented for an area search game in which two players, a 
searcher and a target, move independently through an area. In this game, the payoff is 
the number of detections of the target by the searcher. For each iteration of the game, 
an upper and lower bound on the value of the game were determined and as the number 
of iterations of the game increased, these bounds converged to the actual solution. In 
the games examined, te convergence of the bounds was closely approximated by a 
power function (o"), with large games converging more slowly. Because of the ob- 
served symmetrical convergence of the bounds, an accurate approximation of the value 


of the game was obtainable from the average of the upper and lower bounds. 
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I. INTRODUCTION 


A. BACKGROUND 

The convergence properties of a computational method for solving finite matrix 
games was investigated. This method, Fictitious Plav, was introduced by George W. 
Brown [Ref. I] and is an iterative method based on the imagined play of the two game 
participants. At each fictitious play iteration, Brown’s technique computes upper and 
lower bounds on the value of the game and approximates the optimal strategy for each 
plaver. For the games examined here, the convergence characteristics of the upper and 
lower bounds allow for an accurate approximation of the value of the game after rela- 
tively few iterations. Although the convergence rate of the bounds to the value of the 
game is slow, this iterative process allows the solving of large matrix problems which 
tend to become cumbersome with other common methods, e.g., Linear Programming. 
Very little is Known about the convergence properties of Fictitious Plav, and it is the 
purpose of this study to experimentally examine the rate of convergence for a specific 


two-person zero-sum area search game. 


B. PROBLEM STATEMENT 
This study was motivated by an area search game in which a searcher looks for an 
evading target, each moving among a finite number of cells in discrete time periods. The 
searcher and target each independently select a path through the search area (a pure 
Strategv) or some probabilistic combination of paths (a nuxed strategy). These paths 
are feasible combinations of cells serially connected over a time period 7. That is, if the 
current cell is 7, the next cell must be selected from a set C, of neighboring cells. Al- 
though it will be assumed here, it is not necessary that cell ¢ have the same set of 
neighbors for both searcher and target. For each game play, the searcher and target 
select feasible 7-time period paths. The pavoff is the expected number of times the 
searcher and target are in the same cell in the same time period. The searcher attempts 
to maximize and the target minimize this pavoff. 

Because the number of paths can be quite large, Fictitious Play was selected to solve 
this game. It soon became evident that the rate of convergence of Fictitious Play would 


determine whether or not it was a useful solution method. 


C. PREVIOUS WORK 

Fictitious Plav was first introduced by G.W. Brown [Ref. I] as an iterative process 
for solving finite two-person zero-sum games. Brown hypothesized that the rate of 
convergence to the value of the game was proportional to I/n , where » is the number 
of fictitious play iterations. Julia Robinson [Ref. 2] proved the process converged, thus 
formally demonstrating its potential validity as a solution method. J.M. Danskin 
[Ref. 3] showed that Fictitious Play applies to continuous two-person zero-sum games 
as well. S. Karlin [Ref. 4] hypothesized that the rate of convergence was 1/,/n , but 
further asserted that in practice it could be expected to converge more rapidly. No 
further work or relevant information on the convergence properties of Brown’s Fictitious 
Play had been discoverec up to the time of this study. 


Il. METHODOLOGY 
A. FINITE MATRIX GAME 


The area search game presented here can be represented as a finite matrix game. 
The elements of the pavoff matrix are the number of detections of the target by the 
searcher, i.e., the number of time periods when the searcher and target are in the same 
cell. Figure 1 on page 4 depicts this matrix game, where 


a, = pure strategy 1 of searcher (a feasible T-time period path), 
B, = pure strategy } of target (a feasible T-time period path), and 
r, = number of detections 


ome — 1.2.....7 atid j = 1,2....,"1. 


SEARCHER 


TARGET 





Figure 1. Finite Matrix Area Search Game 


In this finite matrix game, the searcher can calculate a security level V; , as 


Vo= ey renin 


Similarly the target can calculate a security level V;, as 


V>= one Cant ee 


In all cases, V; << V; andif V;,= V,;=V, the game has an equilibrium or saddle point. 


Associated with this saddle point is the value of the game V, and optimal pure strategies 


a andes . 


In games where equilibrium points do not exist, mixed strategies can be used to 
specify a value of the game. A mixed strategy 1s a set of pure strategies o, , that are 


weighted with probabilities x, , where 


=I and x;2> 0. 


For the searcher, a mixed strategy is denoted as X = (x,q,, x,0,,..., x,a,), and for the 
target, it is denoted as Y = (y,f,, 3283,..-, ¥nBm)- With mixed strategies, the security levels 
for the searcher and target are calculated respectively by: 


oS max min) x0/%y 
7 


and 


Ve — hi max) xyyry: 
aia ll a 


iy 
John von Neumann [Ref. 5] showed that 
ee 


where J’ is the value of the game. The searcher mixed strategy which achieves V 1s 
A* , the searcher’s optimal mixed strategy; and, the target mixed strategy which achieves 


Vis }™, the target’s optimal mixed strategy. 


B. FICTITIOUS PLAY 
Fictitious Play is an iterative method for approximating the V’, X* and Y* for a 
two-person zero-sum gamie. This method was first introduced by George W. Brown 


[Ref. 1] and is conceptuslly described as follows: 


The iterative method in question can be loosely characterized bv the fact that it rests 
on the traditional statistician’s philosophy of basing future decisions on the relevant 
past history. Visualize two statisticians, perhaps ignorant of min-max theory, play- 
ing manv plavs of the same discrete zero-sum game. One might naturally expect a 
statistician to keep track of the opponent’s past play and, in the absence of a more 
sophisticated calculation. perhaps to choose at each play the optimum pure strategy 
against the nuxture represented by all the opponent’s past plays. For calculation 
purposes the rule used here is that strategies will be named in turn for each side, 


choosing at each turn a pure strategv which 1s optimal against the cumulative his- 
tory of the opponent’s play to date. [Ref. I: p. 374] 


The method is a relatively simple iterative process that directs a player to select an op- 
timal pure strategy in response to the current empirical mixed strategy of his opponent. 
Applied to the area search game, an iteration of this procedure consists of the following 


steps. 


1. Based on an equal weighting of all the searcher’s pure strategies observed so far 
by the target, the target selects the best pure strategy response. 


2. A lower bound on the value of the game is computed as the expected number of 
detections when the searcher plays his current mixed strategy and the target selects 
the best pure strategy response. 


3. Based on an equal weighting of all the target’s pure strategies observed so far by 
the searcher, the searcher selects the best pure strategy response. 


4. An upper bound on the value of the game is computed as the expected number of 
detections when the target plays his current mixed strategy and the searcher selects 
the best pure strategy response. (Go to step 1 for next iteration) 


The procedure begins with the target assuming an arbitrary searcher strategy. As the 
number of iterations of the game are increased, the upper and lower bounds on the value 
of the game converge toward the actual value, and any converging subsequence of the 
empirical mixed strategies is an optimal mixed strategy. The convergence rate has been 
observed to be quite slow, so an effective solution might require a large number of Fic- 
titious Plav iterations. The process is considered complete when the difference between 
the bounds on the value of the game 1s sufficiently small. At this point an approximate 
value of the game and approximate optimal strategies for both plavers are obtained. 
The empirical mixed strategies after the Ath iteration of Fictitious Play, A‘ and B’, 
are calculated from the relative frequencies of all the previously selected pure strategies 
of the searcher and target respectively. That is, consider the game that has been replhi- 
cated k times and the searcher has selected pure strategies (a!, «,..., a), where a’ 1s the 
pure strategy chosen in the jth replication. If r, denotes the number of times pure 
Strategy a, 1s used, then the pure strategy a, is weighted with the relative frequency = 


k 
This results in the empirical mixed strategy 


oe eee rn 
A= (> Oy FW gerery a) 


for the searcher and similarly 


, Y r r 
B" = (a B,, mie ete, 7m Bm) 


for the target. 
1. Convergence Rate 

The convergence rate of the upper and lower bounds of the value of the game 
was first hypothesized by G.W. Brown [Ref. I] to be I/n , where nm is the number of it- 
erations. He supported this hypothesis by relating the iterative method, as a difference 
equation, to a set of differential equations for which a convergence rate could be shown. 
The most recently found discussion in the literature on the convergence rate was pre- 
sented by Samuel Karlin [Ref. 4]. He stated: 


It is conjectured that the process converges at a rate 1/./k , where & is the number 
of iterations. In actual cases, it is found that the process is far more efficient than 
is expected theoretically.[Ref. 4: p. 183] 
No reference was made to how or where this conjectured rate of convergence was de- 
termined. It appears that the rate of convergence of Fictitious Play is unclear and re- 


quires further investigation. 


C. DYNAMIC PROGRAMMING 

To use Fictitious Play to solve this area search game, both the searcher and target 
must be able to calculate the best pure strategy response to any mixed strategy of the 
opponent. If the area search game were small enough to allow a total enumeration of 
searcher and target pure strategies (1.e., the payoff matrix could be completely specified), 
then choosing the best pure strategy response would be simple. Assuming, for example, 


that the searcher is the row player, the best row / to play against a mixed strategv 1s 


argmax yr. 


rf j i 
where 
y; = probability of target selecting column j, and 
yr, = colunin } of the payoff matrix. 


The target could likewise find the best column response to any probabilistic combination 


of rows. 


For the area search problem presented here, it is assumed that the large number of 
possible pure strategies (1.e., paths) available for the searcher and target makes total 
enumeration impractical. Another method must be used to determine pure strategy re- 
sponses. The procedure employed is Dynamic Programming. Assume, for example, that 
the target plays a mixed strategy which is known to the searcher. That is, the searcher 
knows all the paths that the target might select and the probability of the target selecting 


each path. From this information the searcher computes 


V(Q), 1 = 1,...,4¥ eager |. ee 


which is the probability of the target being in cell / in time period ¢. These probabilities 
contain all the information necessary for the searcher to select his best response. The 
searcher, as it turns out, does not care what mixed strategy the target uses as long as the 
searcher can determine the Y’,(1) values. 

The searcher can now use Dynamic Programming to compute the best pure strategv 


response to Y(i). The recursion for (= 1,....N and ¢=22,...,7 1s 


Vi) = max{¥Q) + VQ)} and 
JE; 


a,_\(i) = argmax{ }'(/) 15 AG 


JEG, 
where 


1G) = maximum obtainable expected number of target detections from time t+] to 


T when the searcher starts in time period t and 1s in cell j, 
C, = the set of cells accessible from cell i in one time period by the searcher, and 


d({i) = the best next cell to search given the searcher is in cell 1in time period t. 


The recursion begins with 


By solving a similar dynamic program, the target can determine his best pure strategy 
response to any searcher cell occupancy probabilities, 4,(i). 


To demonstrate the validity of this recursion, it 1s observed that 


I’ _,(@) = max{E[# detections at time z|search 1s in cell j at time 7] 
JE C; 


i 


+ fel detections from time # + 1 to 7|Search is in cell; at 
time ¢ and conducted optimally from time :+ 1 to time 7]} 


= ESO) + V,Q)}. 
The first equality follows from the definition of Vj) and the fact that the expected value 
of a sum of random variables is the sum of the expected values. The second equality 
results from conditioning on the target’s cell at time ¢ and (again) the definition of V,(/). 
It is noted that the searcher’s problem is that of finding the longest (i.e., most prof- 
itable) path through the N x T acyclic network in Figure 2 on page 10. When the 


searcher reaches node / in time period 2, the pavoff Y,() 1s received. Arcs connect each 


cell with all cells in the set of accessible cells C,. 





Figure 2. Network of Searcher’s Path Through Search Area 


1. Updating Cell Occupancy Probabilities, X,(z) and ¥,(1) 
In each iteration of fictitious play, the searcher and target update 
Y(7) and 4,(1) respectively, based on the number of iterations performed so far and the 
opponents most recently observed pure strategy. Assigning equal weights at all observed 
pure strategies, the update procedure is straight forward. If the searcher was in cell / at 


time sin the most recently observed pure strategy, then 
ee k—] k=1;: ] 
xto= (44 )axo+e, 


and if the searcher was not in cell i at timer, 


yi) = ( a=t ; y“1(3) 


Likewise, if the target was in cell ¢ at time ¢ in the most recently observed pure strategy, 
then 


ve k—] k-} l 
r= (45 yet. 
and if the target was not in cell ; at timer, 


vty = (45+ Vtg, 


Here k is the current iteration number and X*(/) and Y*(/) are the empirical cell occu- 


pancy probabilities after the Ath iteration. 


Hil. DATA GENERATION 


A. PROGRAM DESCRIPTION 
The upper and lower bound data required for this studv were generated by a modi- 
fied version of an existing computer program provided by Professor J. Eagle at the Naval 
Postgraduate School in Monterey, California. The modified version was developed to 
allow a greater flexibility for variable manipulation. Conceptually the program was di- 
vided into three major areas dealing with Game Theory, Fictitious Play and Dynamic 
Programming. 
1. Finite Matrix Game 
The initial set up of the finite matrix game required inputs from the user that 
included search area size, duration of search, replications of game and initial strategy of 
players. Within this portion, all the possible decision paths (states) for adjacent cell path 
movements during a time period (stage) were determined. The initial inputs and adja- 
cent cell paths were required for transition into the fictitious play portion. 
2. Fictitious Play 
The Fictitious Play portion was the driver of the iterative process. It was re- 
sponsible for deternmuning the mixed strategies of the plavers and evaluating the bounds 
on the value of the game. As the best pure strategies were determined, the bounds were 
reevaluated. The iterative process was started by the selection of an optimal pure 
Strategy for the target against the searcher’s initial inputed strategy. A new lower bound 
on the value of the game was computed. If it was greater (1.e., tighter) than the current 
lower bound, it was retained. Otherwise the new lower bound was ignored. A mixed 
Strategy for the target was then determined from the old mixed strategy and the pure 
Strategy just selected. The process of selecting the best pure strategy, calculating and 
evaluating the opponent’s bound on the game, and determining a new mixed strategy 
was then accomplished for the searcher against the target’s current mixed strategy. 
Conducting this process once for each plaver constituted a replication of the game. The 
determination of the optimal pure strategies and the bounds on the value of the game 
for each plaver required the Dynamic Programming portion of the program. 
3. Dynamic Programming 
Dynamic Programming provided the optimization procedure for the iterative 


process and was considered the optimizer portion. It determined the best search paths 
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for each plaver in response to the mixed strategies of his opponent. The payoff (ex- 
pected number of detections) was maximized for the searcher and minimized for the 
target. These paths became the optimal pure strategies required for the calculation of 
empirical mixed strategies in the iterative process. Associated bounds on the value of 


the game were calculated for each iteration. 


B. PROGRAM VALIDATION 

The computer program was validated with results from a Linear Programming sol- 
ution to the area search game, provided by Professor A. Washburn at the Naval Post- 
graduate School in Monterey, California. A comparison of the Linear Programming 
solutions and the Fictitious Play approximations is presented in Table |. The fictitious 
play approximations were the computed midpoints between the upper and lower bounds 
on the value of the game after 50,000 replications. The difference between the solutions 
of the two approaches is represented as an absolute value. The validity of the fictitious 


play computer program was supported by these results. 


Table 1. COMPARISON OF LINEAR PROGRAMMING AND FICTITIOUS 
PLAY SOLUTIONS muciue of the Game) 


SIZE PERIODS GRAM MING PLAY DIPPERE NCE 
Tae 2800 = 902 000 
es 
2553 
5301 01s | 0000s 













IV. DATA ANALYSIS 


A. CONVERGENCE PROPERTIES 

In validating the Fictitious Play approach, it became apparent that an examination 
of convergence properties was needed. The only relevant information available per- 
tained to convergence rates and was conflicting [Ref. 1,4]. In order to reasonably predict 
a solution, an understanding of convergence characteristics was required. The focus of 
the study became the investigation of convergence properties with specific emphasis on 


convergence symmetry and rate. 


B. CONVERGENCE SYMMETRY 

The upper and lower bounds on the value of the game converge to a solution as the 
number of replications increases. This was proven mathematically by J. Robinson [Ref. 
2]. It was observed in this study that the bounds tended to converge svmmetrically. 
Graphically this is displayed for a 4x4 matrix in Figure 3. This characteristic was pres- 
ent in all cases examined, which included various matrix sizes, shapes and initial player 


positionings. Additional graphic presentations are located in Appendix A. 
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CONVERGENCE OF UPPER AND LOWER BOUNDS WITH MIDPOINT 
4x4 MATRIX 8 TIME PERIODS SOK REPLICATIONS 
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Figure 3. Convergence of Upper and Lower Bounds With Midpoint Solutions 


Since the solution to the game lies lies between the bounds and the bounds appear 
to converge symmetrically, using the midpoint of the bounds as an approximation to the 
value of the game seemed to be a reasonable approach. This method proved to be verv 
successful as evidenced in Table 1 on page 13. Further investigation revealed that 
through the use of the midpoint method an accurate approximation could be predicted 


without requiring a large number of replications. This is supported by a comparison of 


Is 


the midpoint and actual solution for various replications in Table 2. Additional com- 


parisons are available in Appendix B. 


Table 2, MIDPOINT SOLUTIONS FOR MULTIPLE REPLICATIONS 


MATRIX REPLICATIONS | MIDPOINT ACTUAL ABSOLUTE 
SIZE (x1000) SOLUTION ae 








SOLUTION 


ssa 
0 
= 20 










Normally the fictitious plav process 1s considered complete when the difference be- 
tween the bounds achieves some specified positive tolerance level. A small tolerance 
level results in an accurate solution. It was observed that as the game increased in size, 
more replications were required to obtain the same tolerance level. This is illustrated in 


Figure 4. 
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Figure 4. Comparison of Separation Between Bounds for Various Matrix Sizes 


Figure 5 on page 18 compares the convergence of the midpoint solution to that of 
the upper bound for a typical game. The midpoint was in all cases observed to achieve 
a much more accurate estimate of the value of the game than provided by either of the 
bounds. For example, 18,000 replications were required in a 4x4 game to bring the up- 
per bound within 0.005 of the actual solution; and only 400 replications were required 


to bring the midpoint to the same absolute deviation. 


COMPARISON OF CONVERGENCE OF BOUND AND MIDPOINT 
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Figure 5. Comparison of Convergence of an Upper Bound and Midpoint 


By examining further comparisons in Appendix C, it can be seen that as the game size 
increases, the number of replications required by the bound to guarantee a preset abso- 
lute deviation also increases. The number of replications required to give the same ab- 
solution deviation for the midpoint solution appears to be considerably less influenced 
by increasing game sizes. A comparison between the bound and midpoint replications 


required to insure a 0.005 absolute deviation for various game sizes is provided in 
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Table 3. The midpoint method is seen to provide an accurate approximation to the 


solution very quickly and is not greatly influenced by the game size. 


Table 3. REPLICATIONS TO INSURE 0.005 ABSOLUTE DEVIATION FOR 
BOUND AND MIDPOINT 


REPLICATIONS FOR REPLICATIONS FOR 
MATRIX SIZE 0.005 DEVIATION 0.005 DEVIATION 
WITH BOUND WITH MIDPOINT 


5,500 


18,000 a ae 
34,800 a a 
ae 





It can be concluded from the above observations that for the games examined the 
bounds converge symmetrically to a solution. The midpoint between the bounds con- 
verges much more rapidlv to the solution than do the bounds. Additionally, the mid- 


point method 1s apparently not greatly hindered by an increase 1n game size. 


C. CONVERGENCE RATE 

The convergence rate for the Fictitious Plav process is not clearly understood. For 
the area search game, the convergence rates for various size games Were experimentally 
found to be slower than the hypothesized rate 1/7. The rate of convergence of the 
bounds for various games examined and the hypothesized rates are displaved in 


Figure 6. 
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Figure 6. Comparison of Convergence of Upper Bound for Various Game Sizes 


It can be clearly seen in Figure 6, that as the game sizes increase the associated time 
(1.e., number of replications) required to reach a specific deviation also increases. That 
is, the bounds take longer to converge for a larger games. 

Experimentally the data were fitted with the power function (vy = an‘), where n re- 
presented the number of replications. This fit was accomplished by noting that for this 


power function 
In y=Ina+f Inn 
which allowed a linear regression of In y versus In n to be done. Because of the 


large amount of data, every fiftieth replication was fitted. The exponent (f), which re- 
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presents the convergence rate, appeared to range from the lower hypothesized value of 
-1.0 and generally increased as the game size increased. The largest game examined was 
a 10x10 matrix with only 6,850 replications due to the large amount of computer time 
required to generate the data. Table 4 provides the values of (a) and (f) for the fitted 
power functions of various games examined. In all cases, the power function provided 
an excellent fit to the data. This is supported by the closeness to 1.0 of the multiple 
correlation coefficient (R SQUARE), displayed in Table 4. A graphical presentation of 
the fitted data is provided in Appendix C. 


Table 4. POWER FUNCTION FIT OF DATA WITH R SQUARE VALUES 
POWER FUNCTION (y = ont) 


<i eae sy ae Geis 





















It can be concluded for this type of area search game, that the Fictitious Plav ap- 
proach has a convergence rate that 1s representative of a power function. The observed 
6 values ranged from -0.7971 for the smallest game to -0.4495 for the largest. These data 
suggest that Brown’s hypothesized rate of 1/7 (1.e., 6 =—1) 1s in general too optimistic. 
Additionally, Karlin’s rate of 1. /n (i.e., B = —0.5) may also be too optimistic for games 


as large or larger than the 10x10, 20-trme period game examined here. 
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V. CONCLUSIONS 


A. SUMMARY OF CONVERGENCE PROPERTIES 
The fictitious play approach to the two-person zero-sum area search game was 
successfully implemented. Convergence properties of the process, for this type of game, 


were investigated and the following conclusions were reached. 


e For the area search games examined, the upper and lower bounds on the value of 
the game converge symmetrically toward a solution as the number of replications 
of the game is increased. 


e Because of the symmetrical convergence, the midpoint between the bounds pro- 
vides an accurate approximation to the solution. 


e The midpoint solution converges much more quicklv to the actual solution than 
do the bounds and is apparently not greatly influenced by the size of the game. 


e The convergence rate of the process is representative of a power function 
(v= on"). Experimentally, the exponent (f) was observed to varv between -0.797] 
and -0.4495, and generally increased with the size of the game. 


e The convergence of the bounds becomes slower as the size of the game 1s increased. 


By observing the convergence characteristics of the Fictitious Play process, an approach 
for predicting an accurate approximation of the solution was developed. This approach, 
the midpoint method, required less replications of the game and provided an accurate 
approximation of the solution. Because of the increased efficiency and capability to ac- 
curately predict a solution, the Fictitious Play process should be considered a possible 


approach to solving area search games and warrants further investigation. 


B. RECOMMENDATIONS FOR FUTURE STUDY 

The Fictitious Play process provides a relatively simple approach to solving the area 
search game. It not only produces an accurate approximation of the solution of the 
game, but also provides the capability to determine a nearly optimal strategy for each 
player. The following topic is recommended as a possible area for further investigation 
and future study. 

1. Comparison of Linear Programming and Fictitious Play Approaches 

Solving the area search game with the use of computer resources can be ap- 

proached by several methods. One verv promising method is the Linear Programming 
approach of Washburn. The major advantage of this approach is that it does not re- 


quire a large amount of CPU time and gives exact answers. However, it can be verv 


demanding on memory resources, especially as the size of the games increases. In com- 
parison, the fictitious play approach requires minimal memory resources but is ham- 
pered by the large amount of CPU time required and gives approximate solutions. A 
comparison between the Linear Programming and the Fictitious Play approach is re- 
commended for future study, with emphasis on the tradeoffs between the resources of 


CPU time and memory space. 
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APPENDIX A. COMPARISONS OF CONVERGENCE OF UPPER AND 
LOWER BOUNDS ON VALUE OF THE GAME 


CONVERGENCE OF UPPER AND LOWER BOUNDS WITH MIDPOINT 
3x3 MATRIX 6 TIME PERIODS 50,000 REPLICATIONS 
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Figure 7. Convergence of Upper and Lower Bounds With Midpoint: 3x3 and 4x4 
Matrix 
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CONVERGENCE OF UPPER AND LOWER BOUNDS WITH MIDPOINT 
5x5 MATRIX 10 TIME PERIODS 50,000 REPLICATIONS 
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Figure 8. Convergence of Upper and Lower Bounds With Midpoint: 5x5 and 6x6 
Matrix 
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Figure 9. Convergence of Upper and Lower Bounds With Midpoint: 1x6 Matrix 
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APPENDIX B. COMPARISON OF MIDPOINT AND ACTUAL 
SOLUTION 


Table 5. MIDPOINT SOLUTIONS FOR MULTIPLE REPLICATIONS 


MATRIX REPLICATIONS | MIDPOINT ACTUAL ABSOLUTE 
SIZE (x 1000) SOLUTION | SOLUTION a 
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Table 6. MIDPOINT SOLUTIONS FOR MULTIPLE REPLICATIONS 
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APPENDIX C. COMPARISON OF CONVERGENCE TO THE ACTUAL 
SOLUTION OF A BOUND AND MIDPOINT 


COMPARISON OF CONVERGENCE OF BOUND AND MIDPOINT 
3x3 MATRIX 6 TIME PERIODS 50,000 REPLICATIONS 
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Figure 10. Convergence of a Bound and Midpoint for a 3x3 and 4x4 Matrix Game 
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COMPARISON OF CONVERGENCE OF BOUND AND MIDPOINT 
5x5 MATRIX 10 TIME PERIODS 50,000 REPLICATIONS 
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Figure 11. Convergence of a Bound and Midpoint for a 5x5 and 6x6 Matrix Game 
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APPENDIX D. POWER FUNCTION FITTING OF DATA FOR VARIOUS 
GAME SIZES 


CONVERGENCE DATA FITTED WITH POWER FUNCTION 
3x3 MATRIX 6 TIME PERIODS 50,000 REPLICATIONS 
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Figure 12. Convergence Data From 3x3 and 4x4 Matrix Fitted With Power Func- 
tion 
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CONVERGENCE DATA FITTED WITH POWER FUNCTION 
5x5 MATRIX 10 TIME PERIODS 50,000 REPLICATIONS 
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Figure 13. Convergence Data From 5x5 and 6x6 Matrix Fitted With Power Func- 
tion 
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